Pandas Profiling Report

Dataset statistics

Number of variables	9
Number of observations	5693
Missing cells	0
Missing cells (%)	0.0%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	400.4 KiB
Average record size in memory	72.0 B

Variable types

Numeric	9

Alerts

`gross_revenue` is highly correlated with `qtt_invoices` and 2 other fields	High correlation
`recency_days` is highly correlated with `qtt_invoices`	High correlation
`qtt_invoices` is highly correlated with `gross_revenue` and 4 other fields	High correlation
`unique_products` is highly correlated with `gross_revenue` and 1 other fields	High correlation
`unique_items` is highly correlated with `gross_revenue` and 3 other fields	High correlation
`daily_purchase_rate` is highly correlated with `qtt_invoices` and 1 other fields	High correlation
`total_prod_returned` is highly correlated with `qtt_invoices`	High correlation
`gross_revenue` is highly correlated with `qtt_invoices` and 1 other fields	High correlation
`qtt_invoices` is highly correlated with `gross_revenue` and 1 other fields	High correlation
`unique_items` is highly correlated with `gross_revenue` and 1 other fields	High correlation
`gross_revenue` is highly correlated with `qtt_invoices` and 2 other fields	High correlation
`qtt_invoices` is highly correlated with `gross_revenue` and 2 other fields	High correlation
`unique_products` is highly correlated with `gross_revenue` and 1 other fields	High correlation
`unique_items` is highly correlated with `gross_revenue` and 2 other fields	High correlation
`daily_purchase_rate` is highly correlated with `qtt_invoices`	High correlation
`df_index` is highly correlated with `customer_id` and 1 other fields	High correlation
`customer_id` is highly correlated with `df_index` and 1 other fields	High correlation
`gross_revenue` is highly correlated with `qtt_invoices` and 3 other fields	High correlation
`recency_days` is highly correlated with `df_index` and 1 other fields	High correlation
`qtt_invoices` is highly correlated with `gross_revenue` and 3 other fields	High correlation
`unique_products` is highly correlated with `gross_revenue` and 2 other fields	High correlation
`unique_items` is highly correlated with `gross_revenue` and 3 other fields	High correlation
`total_prod_returned` is highly correlated with `gross_revenue` and 2 other fields	High correlation
`gross_revenue` is highly skewed (γ1 = 23.1789984)	Skewed
`unique_items` is highly skewed (γ1 = 25.19954694)	Skewed
`total_prod_returned` is highly skewed (γ1 = 28.80267821)	Skewed
`df_index` is uniformly distributed	Uniform
`df_index` has unique values	Unique
`customer_id` has unique values	Unique
`total_prod_returned` has 4191 (73.6%) zeros	Zeros

Reproduction

Analysis started	2022-08-22 21:26:48.797450
Analysis finished	2022-08-22 21:27:23.224265
Duration	34.43 seconds
Software version	pandas-profiling v3.2.0
Download configuration	config.json

df_index
Real number (ℝ_≥0)

HIGH CORRELATION
UNIFORM
UNIQUE

Distinct	5693
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	2894.806605

Minimum	0
Maximum	5783
Zeros	1
Zeros (%)	< 0.1%
Negative	0
Negative (%)	0.0%
Memory size	44.6 KiB

Quantile statistics

Minimum	0
5-th percentile	289.6
Q1	1454
median	2897
Q3	4339
95-th percentile	5492.4
Maximum	5783
Range	5783
Interquartile range (IQR)	2885

Descriptive statistics

Standard deviation	1668.357134
Coefficient of variation (CV)	0.5763276661
Kurtosis	-1.196233201
Mean	2894.806605
Median Absolute Deviation (MAD)	1443
Skewness	-0.003582371647
Sum	16480134
Variance	2783415.527
Monotonicity	Strictly increasing

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	1	< 0.1%
3888	1	< 0.1%
3864	1	< 0.1%
3863	1	< 0.1%
3862	1	< 0.1%
3861	1	< 0.1%
3860	1	< 0.1%
3859	1	< 0.1%
3858	1	< 0.1%
3857	1	< 0.1%
Other values (5683)	5683	99.8%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	1	< 0.1%
1	1	< 0.1%
2	1	< 0.1%
3	1	< 0.1%
4	1	< 0.1%
5	1	< 0.1%
6	1	< 0.1%
7	1	< 0.1%
8	1	< 0.1%
9	1	< 0.1%

Value	Count	Frequency (%)
5783	1	< 0.1%
5782	1	< 0.1%
5781	1	< 0.1%
5780	1	< 0.1%
5779	1	< 0.1%
5778	1	< 0.1%
5777	1	< 0.1%
5776	1	< 0.1%
5775	1	< 0.1%
5774	1	< 0.1%

customer_id
Real number (ℝ_≥0)

HIGH CORRELATION
UNIQUE

Distinct	5693
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	16601.49587

Minimum	12347
Maximum	22709
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	44.6 KiB

Quantile statistics

Minimum	12347
5-th percentile	12700.6
Q1	14289
median	16229
Q3	18211
95-th percentile	21732.8
Maximum	22709
Range	10362
Interquartile range (IQR)	3922

Descriptive statistics

Standard deviation	2808.146205
Coefficient of variation (CV)	0.1691501914
Kurtosis	-0.8215450043
Mean	16601.49587
Median Absolute Deviation (MAD)	1962
Skewness	0.4411283657
Sum	94512316
Variance	7885685.106
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
17850	1	< 0.1%
21111	1	< 0.1%
16498	1	< 0.1%
13745	1	< 0.1%
15584	1	< 0.1%
21089	1	< 0.1%
21088	1	< 0.1%
21087	1	< 0.1%
21086	1	< 0.1%
15578	1	< 0.1%
Other values (5683)	5683	99.8%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
12347	1	< 0.1%
12348	1	< 0.1%
12349	1	< 0.1%
12350	1	< 0.1%
12352	1	< 0.1%
12353	1	< 0.1%
12354	1	< 0.1%
12355	1	< 0.1%
12356	1	< 0.1%
12357	1	< 0.1%

Value	Count	Frequency (%)
22709	1	< 0.1%
22708	1	< 0.1%
22707	1	< 0.1%
22706	1	< 0.1%
22705	1	< 0.1%
22704	1	< 0.1%
22700	1	< 0.1%
22699	1	< 0.1%
22696	1	< 0.1%
22695	1	< 0.1%

gross_revenue
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
SKEWED

Distinct	5447
Distinct (%)	95.7%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	1753.54654

Minimum	0.42
Maximum	279138.02
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	44.6 KiB

Quantile statistics

Minimum	0.42
5-th percentile	13.128
Q1	236.09
median	612.78
Q3	1569.11
95-th percentile	5260.23
Maximum	279138.02
Range	279137.6
Interquartile range (IQR)	1333.02

Descriptive statistics

Standard deviation	7495.95906
Coefficient of variation (CV)	4.27474201
Kurtosis	705.9115845
Mean	1753.54654
Median Absolute Deviation (MAD)	478.74
Skewness	23.1789984
Sum	9982940.45
Variance	56189402.23
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
7.95	9	0.2%
1.25	8	0.1%
2.95	8	0.1%
4.95	8	0.1%
12.75	7	0.1%
3.75	7	0.1%
1.65	7	0.1%
5.95	6	0.1%
7.5	6	0.1%
4.25	6	0.1%
Other values (5437)	5621	98.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0.42	1	< 0.1%
0.65	1	< 0.1%
0.79	1	< 0.1%
0.84	4	0.1%
0.85	3	0.1%
1.07	1	< 0.1%
1.25	8	0.1%
1.44	1	< 0.1%
1.65	7	0.1%
1.69	1	< 0.1%

Value	Count	Frequency (%)
279138.02	1	< 0.1%
259657.3	1	< 0.1%
194550.79	1	< 0.1%
140450.72	1	< 0.1%
124564.53	1	< 0.1%
117379.63	1	< 0.1%
91062.38	1	< 0.1%
72882.09	1	< 0.1%
66653.56	1	< 0.1%
65039.62	1	< 0.1%

recency_days
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION

Distinct	304
Distinct (%)	5.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	116.8703671

Minimum	0
Maximum	373
Zeros	37
Zeros (%)	0.6%
Negative	0
Negative (%)	0.0%
Memory size	44.6 KiB

Quantile statistics

Minimum	0
5-th percentile	3
Q1	23
median	71
Q3	200
95-th percentile	338
Maximum	373
Range	373
Interquartile range (IQR)	177

Descriptive statistics

Standard deviation	111.6209282
Coefficient of variation (CV)	0.9550832341
Kurtosis	-0.6403154021
Mean	116.8703671
Median Absolute Deviation (MAD)	61
Skewness	0.8153515696
Sum	665343
Variance	12459.23161
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	110	1.9%
4	105	1.8%
3	98	1.7%
2	92	1.6%
10	86	1.5%
8	82	1.4%
17	79	1.4%
9	79	1.4%
7	78	1.4%
15	66	1.2%
Other values (294)	4818	84.6%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	37	0.6%
1	110	1.9%
2	92	1.6%
3	98	1.7%
4	105	1.8%
5	52	0.9%
7	78	1.4%
8	82	1.4%
9	79	1.4%
10	86	1.5%

Value	Count	Frequency (%)
373	23	0.4%
372	23	0.4%
371	17	0.3%
369	4	0.1%
368	13	0.2%
367	16	0.3%
366	15	0.3%
365	19	0.3%
364	11	0.2%
362	7	0.1%

qtt_invoices
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	56
Distinct (%)	1.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	3.471807483

Minimum	1
Maximum	206
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	44.6 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	1
median	1
Q3	4
95-th percentile	11
Maximum	206
Range	205
Interquartile range (IQR)	3

Descriptive statistics

Standard deviation	6.814409585
Coefficient of variation (CV)	1.962784405
Kurtosis	301.9942725
Mean	3.471807483
Median Absolute Deviation (MAD)	0
Skewness	13.19072233
Sum	19765
Variance	46.43617799
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	2870	50.4%
2	825	14.5%
3	502	8.8%
4	394	6.9%
5	237	4.2%
6	173	3.0%
7	138	2.4%
8	98	1.7%
9	69	1.2%
10	55	1.0%
Other values (46)	332	5.8%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	2870	50.4%
2	825	14.5%
3	502	8.8%
4	394	6.9%
5	237	4.2%
6	173	3.0%
7	138	2.4%
8	98	1.7%
9	69	1.2%
10	55	1.0%

Value	Count	Frequency (%)
206	1	< 0.1%
199	1	< 0.1%
124	1	< 0.1%
97	1	< 0.1%
91	2	< 0.1%
86	1	< 0.1%
72	1	< 0.1%
62	2	< 0.1%
60	1	< 0.1%
57	1	< 0.1%

unique_products
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	439
Distinct (%)	7.7%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	69.69295626

Minimum	1
Maximum	1786
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	44.6 KiB

Quantile statistics

Minimum	1
5-th percentile	2
Q1	13
median	36
Q3	85
95-th percentile	241.4
Maximum	1786
Range	1785
Interquartile range (IQR)	72

Descriptive statistics

Standard deviation	101.7406736
Coefficient of variation (CV)	1.459841555
Kurtosis	43.87384045
Mean	69.69295626
Median Absolute Deviation (MAD)	28
Skewness	4.703075254
Sum	396762
Variance	10351.16467
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	278	4.9%
2	149	2.6%
3	112	2.0%
10	101	1.8%
5	97	1.7%
9	96	1.7%
8	93	1.6%
6	93	1.6%
11	92	1.6%
7	90	1.6%
Other values (429)	4492	78.9%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	278	4.9%
2	149	2.6%
3	112	2.0%
4	90	1.6%
5	97	1.7%
6	93	1.6%
7	90	1.6%
8	93	1.6%
9	96	1.7%
10	101	1.8%

Value	Count	Frequency (%)
1786	1	< 0.1%
1766	1	< 0.1%
1322	1	< 0.1%
1118	1	< 0.1%
1109	1	< 0.1%
884	1	< 0.1%
817	1	< 0.1%
748	1	< 0.1%
730	1	< 0.1%
720	1	< 0.1%

unique_items
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
SKEWED

Distinct	1838
Distinct (%)	32.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	948.5617425

Minimum	1
Maximum	196844
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	44.6 KiB

Quantile statistics

Minimum	1
5-th percentile	4
Q1	106
median	316
Q3	804
95-th percentile	2913.2
Maximum	196844
Range	196843
Interquartile range (IQR)	698

Descriptive statistics

Standard deviation	4183.804245
Coefficient of variation (CV)	4.410682044
Kurtosis	948.0685665
Mean	948.5617425
Median Absolute Deviation (MAD)	253
Skewness	25.19954694
Sum	5400162
Variance	17504217.96
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	114	2.0%
2	73	1.3%
3	51	0.9%
4	49	0.9%
5	35	0.6%
6	29	0.5%
12	25	0.4%
88	22	0.4%
72	21	0.4%
7	20	0.4%
Other values (1828)	5254	92.3%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	114	2.0%
2	73	1.3%
3	51	0.9%
4	49	0.9%
5	35	0.6%
6	29	0.5%
7	20	0.4%
8	18	0.3%
9	7	0.1%
10	17	0.3%

Value	Count	Frequency (%)
196844	1	< 0.1%
80263	1	< 0.1%
77373	1	< 0.1%
69993	1	< 0.1%
64549	1	< 0.1%
64124	1	< 0.1%
63312	1	< 0.1%
58343	1	< 0.1%
57885	1	< 0.1%
50255	1	< 0.1%

daily_purchase_rate
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION

Distinct	1226
Distinct (%)	21.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	0.5473078999

Minimum	0.005449591281
Maximum	17
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	44.6 KiB

Quantile statistics

Minimum	0.005449591281
5-th percentile	0.01104159896
Q1	0.02492211838
median	1
Q3	1
95-th percentile	1
Maximum	17
Range	16.99455041
Interquartile range (IQR)	0.9750778816

Descriptive statistics

Standard deviation	0.5502787309
Coefficient of variation (CV)	1.00542808
Kurtosis	139.1642784
Mean	0.5473078999
Median Absolute Deviation (MAD)	0
Skewness	4.859773608
Sum	3115.823874
Variance	0.3028066817
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	2878	50.6%
2	47	0.8%
0.0625	18	0.3%
0.02777777778	17	0.3%
0.02380952381	16	0.3%
0.08333333333	15	0.3%
0.09090909091	15	0.3%
0.02941176471	14	0.2%
0.03448275862	14	0.2%
0.07692307692	13	0.2%
Other values (1216)	2646	46.5%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0.005449591281	1	< 0.1%
0.005464480874	1	< 0.1%
0.005479452055	1	< 0.1%
0.005494505495	1	< 0.1%
0.005586592179	2	< 0.1%
0.005602240896	1	< 0.1%
0.005617977528	2	< 0.1%
0.00566572238	1	< 0.1%
0.005681818182	2	< 0.1%
0.005698005698	3	0.1%

Value	Count	Frequency (%)
17	1	< 0.1%
4	1	< 0.1%
3	5	0.1%
2	47	0.8%
1.142857143	1	< 0.1%
1	2878	50.6%
0.75	1	< 0.1%
0.6666666667	3	0.1%
0.550802139	1	< 0.1%
0.5335120643	1	< 0.1%

total_prod_returned
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
SKEWED
ZEROS

Distinct	212
Distinct (%)	3.7%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	16.6597576

Minimum	0
Maximum	8004
Zeros	4191
Zeros (%)	73.6%
Negative	0
Negative (%)	0.0%
Memory size	44.6 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	1
95-th percentile	38
Maximum	8004
Range	8004
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	166.7090233
Coefficient of variation (CV)	10.00668961
Kurtosis	1115.784459
Mean	16.6597576
Median Absolute Deviation (MAD)	0
Skewness	28.80267821
Sum	94844
Variance	27791.89845
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	4191	73.6%
1	169	3.0%
2	150	2.6%
3	105	1.8%
4	89	1.6%
6	78	1.4%
5	61	1.1%
12	52	0.9%
7	44	0.8%
8	43	0.8%
Other values (202)	711	12.5%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	4191	73.6%
1	169	3.0%
2	150	2.6%
3	105	1.8%
4	89	1.6%
5	61	1.1%
6	78	1.4%
7	44	0.8%
8	43	0.8%
9	41	0.7%

Value	Count	Frequency (%)
8004	1	< 0.1%
4427	1	< 0.1%
3768	1	< 0.1%
3332	1	< 0.1%
2878	1	< 0.1%
2022	1	< 0.1%
2012	1	< 0.1%
1776	1	< 0.1%
1594	1	< 0.1%
1535	2	< 0.1%

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Count
Matrix

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

First rows

	df_index	customer_id	gross_revenue	recency_days	qtt_invoices	unique_products	unique_items	daily_purchase_rate	total_prod_returned
0	0	17850	5391.21	372.0	34.0	21.0	1733.0	17.000000	40.0
1	1	13047	3232.59	56.0	9.0	105.0	1390.0	0.028302	35.0
2	2	12583	6705.38	2.0	15.0	114.0	5028.0	0.040323	50.0
3	3	13748	948.25	95.0	5.0	24.0	439.0	0.017921	0.0
4	4	15100	876.00	333.0	3.0	1.0	80.0	0.073171	22.0
5	5	15291	4623.30	25.0	14.0	61.0	2102.0	0.040115	29.0
6	6	14688	5630.87	7.0	21.0	148.0	3621.0	0.057221	399.0
7	7	17809	5411.91	16.0	12.0	46.0	2057.0	0.033520	41.0
8	8	15311	60767.90	0.0	91.0	567.0	38194.0	0.243316	474.0
9	9	16098	2005.63	87.0	7.0	34.0	613.0	0.024390	0.0

Last rows

	df_index	customer_id	gross_revenue	recency_days	qtt_invoices	unique_products	unique_items	daily_purchase_rate
5683	5774	22700	4839.42	1.0	1.0	55.0	1074.0	1.0
5684	5775	13298	360.00	1.0	1.0	2.0	96.0	1.0
5685	5776	14569	227.39	1.0	1.0	10.0	79.0	1.0
5686	5777	22704	17.90	1.0	1.0	7.0	14.0	1.0
5687	5778	22705	3.35	1.0	1.0	2.0	2.0	1.0
5688	5779	22706	5699.00	1.0	1.0	634.0	1747.0	1.0
5689	5780	22707	6756.06	0.0	1.0	730.0	2010.0	1.0
5690	5781	22708	3217.20	0.0	1.0	56.0	654.0	1.0
5691	5782	22709	3950.72	0.0	1.0	217.0	731.0	1.0
5692	5783	12713	794.55	0.0	1.0	37.0	505.0	1.0

Overview

Variables

Interactions

Correlations

Spearman's ρ

Pearson's r

Kendall's τ

Phik (φk)

Missing values

Sample

First rows

Last rows